Applications of sketches in network traffic measurement: A survey

Accurate and timely network traffic measurement is essential for network status monitoring, network fault analysis, network intrusion detection, and network security management. With the rapid development of the network, massive network traffic brings severe challenges to network traffic measurement. However, existing measurement methods suffer from many limitations for effectively recording and accurately analyzing big-volume traffic. Recently, sketches, a family of probabilistic data structures that employ hashing technology for summarizing traffic data, have been widely used to solve these problems. However, current literature still lacks a thorough review on sketch-based traffic measurement methods to offer a comprehensive insight on how to apply sketches for fulfilling various traffic measurement tasks. In this paper, we provide a detailed and comprehensive review on the applications of sketches in network traffic measurement. To this end, we classify the network traffic measurement tasks into four categories based on the target of traffic measurement, namely cardinality estimation, flow size estimation, change anomaly detection, and persistent spreader identification. First, we briefly introduce these four types of traffic measurement tasks and discuss the advantages of applying sketches. Then, we propose a series of requirements with regard to the applications of sketches in network traffic measurement. After that, we perform a fine-grained classification for each sketch-based measurement category according to the technologies applied on sketches. During the review, we evaluate the performance, advantages and disadvantages of current sketch-based traffic measurement methods based on the proposed requirements. Through the thorough review, we gain a number of valuable implications that can guide us to choose and design proper traffic measurement methods based on sketches. We also review a number of general sketches that are highly expected in modern network systems to simultaneously perform multiple traffic measurement tasks and discuss their performance based on the proposed requirements. Finally, through our serious review, we summarize a number of open issues and identify several promising research directions.     

A fast procedure for the estimation of the hydrogen storage capacity by cryoadsorption of metal-organic framework materials from their available porous properties

In order to identify the best porous materials for the cryogenic physisorption of hydrogen, high-throughput calculations are performed starting, i.e., from the collected information in crystallographic databases. However, these calculations, like molecular simulations, require specific training and significant computational cost. Herein, a relatively simple procedure is proposed to estimate and compare hydrogen uptakes at 77 K and pressure values from 40 bar starting from the porous properties of MOF materials, without involving simulation tools. This procedure uses definitions for adsorption and considers the adsorbed phase as an incompressible fluid whose pressure-density change is that for the liquid phase at 19 K. For the 7000 structures from the CoRE MOF database, the average error of the predictions is only of 1% from reference values at 100 bar, with an SD of ±8%. This accuracy is lower than that from simulation tools, but involving lower computational cost and training.     

Distant Supervised Relation Extraction with Cost-Sensitive Loss

Recently, many researchers have concentrated on distant supervision relation extraction (DSRE). DSRE has solved the problem of the lack of data for supervised learning, however, the data automatically labeled by DSRE has a serious problem, which is class imbalance. The data from the majority class obviously dominates the dataset, in this case, most neural network classifiers will have a strong bias towards the majority class, so they cannot correctly classify the minority class. Studies have shown that the degree of separability between classes greatly determines the performance of imbalanced data. Therefore, in this paper we propose a novel model, which combines class-to-class separability and cost-sensitive learning to adjust the maximum reachable cost of misclassification, thus improving the performance of imbalanced data sets under distant supervision. Experiments have shown that our method is more effective for DSRE than baseline methods.     

Synchroextracting chirplet transform for accurate IF estimate and perfect signal reconstruction

Synchroextracting transform (SET) is a recently developed time-frequency analysis (TFA) method aiming to achieve a highly concentrated TF representation. However, SET suffers from two drawbacks. The one is that SET is based upon the assumption of constant amplitude and linear frequency modulation signals, therefore it is unsatisfactory for strongly amplitude-modulated and frequency-modulated (AM-FM) signals. The other is that SET does not allow for perfect signal reconstruction, which leads to large reconstruction errors when addressing fast-varying signals. To tackle these problems, in this paper, we first present some theoretical analysis for the SET method, including the existence of the fixed squeeze frequency, the performances of the instantaneous frequency (IF) estimator and the SET reconstruction. Then, a new TFA method, named synchroextracting chirplet transform (SECT), is proposed, which sharpens the TF representation by extracting the TF points satisfying IF equation, and retains an excellent signal reconstruction ability. Numerical experiments on simulated and real signals demonstrate the effectiveness of the SECT method.     

Distributed two‐stage state estimation with event‐triggered strategy for multirate sensor networks

This paper investigates the state estimation issue for a class of wireless sensor networks (WSNs) with the consideration of limited energy resources. First, a multirate estimation model is established, and then, a new event‐triggered two‐stage information fusion algorithm is developed based on the optimal fusion criterion weighted by matrices. Compared with the existing methods, the presented fusion algorithm can significantly reduce the communication cost in WSNs and save energy resources of sensors efficiently. Furthermore, by presetting a desired containment probability over the interval [0,1] with the developed event‐triggered mechanism, one can obtain a suitable compromise between the communication cost and the estimation accuracy. Finally, a numerical simulation for the WSN tracking system is given to demonstrate the effectiveness of the proposed method.     

An enhanced state estimation for linear parabolic PDE systems with mobile sensors

This paper studies an enhanced state estimation problem of distributed parameter processes modeled by a linear parabolic partial differential equation using mobile sensors. The proposed estimation scheme contains a state estimator and the guidance of mobile sensors, where the spatial domain is decomposed into multiple subdomains according to the number of sensors and each sensor is capable of moving within the respective subdomain. The state estimator is desired to make the state estimation error system exponentially stable while providing an performance bound. The mobile sensor guidance is used to enhance the transient performance of the error system. By the Lyapunov direct technique, an integrated design of state estimator and mobile sensor guidance laws is developed in the form of bilinear matrix inequalities (BMIs) to meet the desired design objectives. Moreover, to make the performance bound as small as possible, a suboptimal enhanced state estimation problem is formulated as a BMI optimization one, which can be solved via an iterative linear matrix inequality algorithm. Finally, numerical simulations are given to show the effectiveness of the proposed method.     

一种灰度化混合法在集装箱箱号识别中的运用

研究一种基于机器视觉的集装箱箱号识别方法。对于集装箱彩色图像预处理过程中的灰度化方法，传统的灰度化算法不能有效弥补图像中污损或其他信息缺失的部分，因此，本文提出使用主成分分析法（PCA）结合贝叶斯阈值估计灰度变化率的混合法对图像的灰度化进行优化，可以在判断图像中某一点灰度值与周围相邻像素点的灰度值的变化率后，弥补缺失信息，有效确定边缘特征，从而使后续的字符识别准确率大大提高。最后使用该算法模型设计实现一套用于港口集装箱的智能检测系统。经过Matlab实验验证，在对50幅港口集装箱箱号图像的识别中，通过使用本文提出的混合灰度化方法，与普通的均值法和加权平均法的灰度化方法相比，准确率更高，其中单一字符准确率可达96%，箱号准确率可达92%。     

Evaluation of physiological workload assessment methods using heart rate and accelerometry for a smart wearable system

Work metabolism (WM) can be accurately estimated by oxygen consumption (VO₂), which is commonly assessed by heart rate (HR) in field studies. However, the VO₂–HR relationship is influenced by individual capacity and activity characteristics. The purpose of this study was to evaluate three models for estimating WM compared with indirect calorimetry, during simulated work activities. The techniques were: the HR-Flex model; HR branched model, combining HR with hip-worn accelerometers (ACC); and HR?+?arm-leg ACC model, combining HR with wrist- and thigh-worn ACC. Twelve participants performed five simulated work activities and three submaximal tests. The HR?+?arm-leg ACC model had the overall best performance with limits of agreement (LoA) of ?3.94 and 2.00?mL/min/kg, while the HR-Flex model had ?5.01 and 5.36?mL/min/kg and the branched model, ?6.71 and 1.52?mL/min/kg. In conclusion, the HR?+?arm-leg ACC model should, when feasible, be preferred in wearable systems for WM estimation.

Practitioner Summary: Work with high energy demand can impair employees’ health and life quality. Three models were evaluated for estimating work metabolism during simulated tasks. The model combining heart rate, wrist- and thigh-worn accelerometers showed the best accuracy. This is, when feasible, suggested for wearable systems to assess work metabolism.     

Improved Input and State Estimation for Linear Stochastic Systems with Direct Feedthrough

This paper is concerned with the problem of joint input and state estimation for linear stochastic systems with direct feedthrough. Based on the fact that each unknown input between any two time steps is always bounded, a novel improved algorithm is proposed. Compared with existing results, this algorithm can effectively enhance estimation accuracy. Moreover, the stability of the algorithm is also discussed. Finally, an illustrative example is given to demonstrate the effectiveness of the proposed approach.